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snoittioiis.  ACTIONS.  AMD  CiDSAL  LiiW 


by  John  McCarthy 


Abstract: 


/ 

L 

A  fonal  theory  is  given  concerning 
altoationa,  ceuaallty  end  the  poaaiblliey 
and  effects  of  actions  Is  given.  The 
theory  la  Intended  to  be  used  by  the 
Advice  Taker,  e  computer  program  that  la 
to  decide  what  to  do  by  reasoning.  Soma 
simple  examples  are  given  of  descriptions 
of  situations  and  deductions  chat  certain 
goals  can  be  achieved. 
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nrrsoraciioH 


Although  formalized  theories  have  been  devised  to  escinrass  the  most 
Important  fields  of  mathematics  and  some  progress  has  been  made  in  formalising 
certain  empirical  sciences,  there  is  at  present  no  formal  theory  in  which  one 
can  e^qirass  the  kind  of  means-ends  analysis  used  in  ordinary  life.  The  closant  _ 
approach  to  such  a  theory  of  which  1  am  aware  is  made  by  Freudenthal  in  Lincos 

Our  approach  to  the  artificial  intelligence  problem  requires  a  formal 
theory.  Haaaly,  we  believe  that  human  intelligencr  depends  essentially  on  the 
fact  that  we  can  represent  in  language  facts  about,  our  situation,  our  goals,  and 
the  effects  of  the  various  actions  we  can  perform.  Moreover,  we  can  draw 
conclusions  from  the  facts  to  the  effect  that  certain  sequences  of  actions  are 
liksly  to  achieve  our  goals. 

In  Programs  with  Common  Sense  C^Jt  ^  discussed  the  advantages  of  having 
a  computer  program,  to  be  called  the  Advice  Taker  that  would  reason  from 
collections  of  facts  about  its  problem  and  derive  statements  about  what  it  could 
do.  The  name  Advice  Taker  came  from  the  hope  that  its  behavior  could  be  Improved 
by  giving  it  advice  in  the  form  of  new  facts  rather  than  by  rewriting  the  program. 
The  reader  is  referred  to  that  paper  for  further  information  about  the  Advice 
Taker  and  to  Minsky's  paper  Steps  Towards  Artificial  Intelligence  fsl  for  a  genaral 
Introduction  to  the  subject. 

The  first  requirement  for  the  Advice  Taker  is  a  formal  system  in  which 
facts  about  situations,  goals  and  actions  can  be  expressed  and  containing  the 
general  facts  about  means  and  ends  as  axioms.  A  start  is  made  in  this  paper  on 
providing  a  system  meeting  the  following  specifications 

#1.  General  properties  of  causality  and  certain  obvious  but  until 
now  unformalized  facts  about  the  possibility  and  results  of 
actions  are  given  ae  axioms. 

/ 

#2,  It  is  a  logical' consequence  of  the  facts  of  a  situation  and  the 
general  axioms  that  certain  persons  can  achieve  certain  goals 
by  taking  certain  actions. 

#3.  The  formal  descriptions  of  situations  should  correspond  as  closely 
as  possible  to  what  people  may  reasonably.be  presumed  to  know  about 
them  when  deciding  what  to  do. 


2.  SITUATIONS  AND  FLUENTS 


One  of  the  basic  entities  in  cui’  theory  is  the  situation.  Intuitively, 
a  situation  is  the  ccxnplete  state  of  affairs  c.t  some  instant  of  time. 

The  laws  of  motion  of  a  system  determine  from  a  situation  all  future 
situations.  Thus  a  situation  corresponds  to  the  notion  in  physics  of  a 
point  in  phase  space.  In  physics,  laws  6Lre  expressed  in  the  form  of 
differential,  equations  which  give  the  complete  motion  of  tie  point  in 
phase  space. 

Our  system  is  not  intended  for  the  complete  descript  on  of 
situations  nor  for  the  description  of  complete  laws  of  mo.ion.  Instead, 
we  deal  with  partial  descriptions  of  situations  and  partia'  laws  of 
motion.  Moreover,  the  emphasis  is  on  the  simple  qualitative  laws  of 
everyday  life  rather  than  on  the  quantitative  laws  of  physics.  As  an 
example,  take  the  fact  that  if  it  is  raining  sind  I  go  outside  I  will  get 
wot . 


Since  a  situation  is  a  complete  state  of  affairs  we  can  never  describe 
a  Situation  completely,  and  therefore  we  pro-''.;.de  no  notation  for  doing  so 
in  our  theory.  Instead,  we  state  facts  aoout  situations  in  the  language 
of  an  extended  predicate  calculus.  Examples  of  such  facts  axe; 

1.  raining  (s) 

meaning  that  it  is  raining  in  situation  s 

2.  time  (s)  ^  1963.720^, 

giving  the  value  of  the  time  in  situation  s.  it  will  usually 
prove  convenient  to  regard  the  time  as  a  function  of  the 
situation  rather  than  vice  versa.  The  reason  for  this  is 
that  tne  nuiuerical  value  of  the  time  is  known  and  important 
only  where  the  laws  of  physics  are  being  used. 

3.  at(l,home,o)  or  at(l,home) (s ) 

meai'ung  that  I  am  at  heme  in  situation  s.  We  nrefer  and 
will  use  the  second  of  thi.  given  notations  that  isolates 
the  situation  variable  since  in  most  if  not  all  cases  we 
wili  be  aule  to  supjress  it  completely. 

We  sna.i  not  describe  in  this  memorandum  the  logical  system  we 
intend  to  use.  Basically,  it  is  a  predicate  calculus,  but  we  shall  use 
the  -notation  and  if  necessary  couditicnai  expressions  as  in  LISP  or 
ALGOI  We  snaj.1  extend  the  meaning  of  the  Boolean  operators  to  operate  on 
predicates.  Thus  by 

at(l,horae)/\  raining 

we  mean  the  same  as 

ks  .  at;' I  ,hfr»’n)(3)  ^  raining(s) 

A  predicate  or  function  whose  argument  is  a  situation  will  be  called 
a  fluent ,  the  foxr^r  being  called  a  propositional  fluent .  Thus,  raining, 
time.,  ar.d  at ( I, home}  are  all  fluents,  the  first  and  last  being  propositional 
f 1 uen+  a  . 
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fli*  ttni  «w  «m4  bj  iMrtM  fer  •  pt^iMl  fiiMCitj  Huit  on  eliM»  end 

•ecerilag  to  agr  liaitoi  wiorotoadtaf  of  what  ko  aiMt,  tko  froMat  uso  of  tho 
ttra  io  justtflod* 

Xa  our  foraulaa  no  will  uouallj  aaaaf*  to  aoo  Cha  fluaata  without 
axfllcltly  wrltlat  varlablaa  roftaaaatiat  ■ituatloaa*  Thia  eortaiipoBdo  to  tha 
uta  of  rondos  varlablaa  la  yrobabitlty  thaory  without  ualag  varlablaa  rapraaoatlag 
polnta  In  tha  aaafla  apaca  avoa  thottph  randoa  varlablaa  aro  auppoaad  to  ba 
ragardad  aa  functlona  daflnad  oa  a  aaapla  apaea. 

Za  fact  wo  ahall  go  furthar  and  glvonan  Intarprotatloa  of  our  thapry  aa 
a  aort  of  sodal  logic  In  which  tha  fluanta  ara  not  ragardad  aa  functlona  at  all. 


! 
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3.  CiUISALITY 


In  order  to  expreaa  eauaal  leva  ve  Introduce  tbi  focond  order  predicate 
ceuae.  The  atatement 

cauae(^)(a) 

where  TT'  ia  a  propoaltional  fluent  ia  Intended  to  aean-  that  tha  aituatlon  a  will 
lead  in  the  future  to  a  situation  that  aatiafiea  t^a  fluent  lb  •  Thua»  eauae(7J^) 
la  itaalf  a  propositional  fluent.  Aa  an  exsaiple  of  its  use  vo  write 

Va.  Vp.  ^person(p)  A  raining  Aoutaide(p)  ? cause (vet(p))j| (a) 

which  aaserts  that  a  person  tdio  ia  outside  whan  it  is  raining  will  gat  wet.  Wa  shall 
■ake  the  convention  that  if  is  a  fluent  then 


lana  the  seats  aa 


Va.-7f(a). 


With  this  convention  ve  can  write  the  previous  atatosMnt  aa 

Wpvperaon(p)  A  raining  ^outside  (p)  Z>  eauaa(wet(p)/ 

which  suppresses  explicit  nention  of  aituationa.  Aa  a  second  axawpla  va  give  a 
special  case  of  the  law  of  falling  bodies  in  tha  forat 

Wt.Vb,  Vt' .VhiCreal(t)/\raal(t')  Araal(h)  ^body  (b) 

A  unaupported(b)A|height(b)  *  hjA^gt^^hjA 

[tta.  .  3cauae(height(b)  <■  h>%gt^A  tiaWBt'«t)  ' 

The  concept  of  causality  ia  intended  to  satisfy  tha  two  following 
general  lava,  which  mmj  be  taken  aa  axioas:- 

Cl,  V.  cause(^)A  ^/^jDcauaa(^) 

C2.  V  cause  (cause(ip  ))  cauae(^) 

C3,  V.cause(<fh]^)  VcausaClTg)  ^  causeCiri  vTtl) 

The  fact  that  we  can  suppress  axpllcit  aiention  of  aituationa  has  Aa 
following  interesting  consequence.  Instead  of  regarding  Aa  Tf's  aa  pradleataa 
ve  aay  regard  theai  aa  proppsitions  and  regard  causa  as  a  new  aDdal  operator,  Tha 
operator  V  seems  then  to  be  equivalent  to  the  H  (necessary)  operator  of  ordinary 
ai^al  logic. 

Conversely,  it  would  appear  that  modal  logic  of  necessity  might  be 
regarded  as  a  monadic  pradlcata  calculus  where  ill  quantifiers  era  ovar  situations. 

In  Ae  present  ease  of  causality,  we  seam  to  hava  our  choice  of  how  A 
proceed.  Regarding  tha  system  aa  a  modal  logic  seems  to  hava  the  following  two 
advantages. 


I,  If  ¥•  UM  th«  pMdleiiU  If  1**  “>»  ^ 

a:i  ;rw‘:i^i:.r4:iriauu 

,.  -,.u u.*-5.r:,snk';r“;:ti-  ^ 

-I  -IS  stt- 

■UtMMtt 

m  tta.  -  tAHt®  ■  «.AWrt  ■  < 

tlM  -  »U  (bit  0  -  .„  •  l)A(Mt  X  .  XI  •  (XoAl)» 

;r~6;““.«r  M  *;x*s.rlu'«”  i»i- 

vi^M  ■C«c«Mnt 

v.vtVKoVxi.ti*<t)  -  tAbtto(.)  -  *oAbui(»)  -  n-p 

c«,..(A.'.ti«e(,‘)  .  t4lA(blt0C')  .x„tl)  A(bitl(.')  -  >ci»(«oAl»)(0 

X.  tkU  CM  however  we  cen  rewrite  the  etetecnt  In  the  fom 

v.,c.uM(A.'.tti«.(.‘)  -  ti«(.>+0ALwtO(«’)-  bitO(.>#bjA 

(^bltl(8')  -  bltl(8)  •  (blc  0(8)AI)J)  (•) 

TiMM  M  eee  that  the  *" 

to  tntroducs  the  euxllUry  quantities  ^  •  -Kuatloc  In  the  eaeo  foroolo. 

»  «  »> !««« u  -“STu  .iS  u  >b. 

■Morthelees,  the  t-euppreeeed  foro  oey  etlli  oe  wortnw.**. 

■idel  Interpretation. 

oo.  .lt«.tl«.  ..rtexpoMl.,  to  •  .Iv"  «•>»•  .«  th.  tta.  «J  U  ta 

the  exloo 

tl.VV#V^Vt.  cauee(tloe  •  tA^)A  teecCtlBe  •  tA^)*^ 
eauee  (tlae  ■  tAf*A^ 

Another  exloo  Is 


T2.  Wt.reel(t)A  t  7  tic:>s*w8e(ttc  -  t) 
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1*.  ACTIONS  AND  THE  can 

We  shall  regard  the  fact  that  a  person  performs  a  certain  action  in  a 
situation  as  a  propositional  fluent.  Thus 

moves  (person,  object,  location)  (a) 

is  regarded  as  asserting  that  person  moves  object  to  location  I'a  the  situation  a. 
The  effect  of  moving  something  is  describee  by 

Wp  Vo  VI.  moves  (p,o,l)  cause  (at(o,l)) 

or  in  the  long  form 

Vs  Vp  Vo  VI. moves  (p,o,l)(s)  cause  (As'. at  (o,l)(8' ))(8) 

In  order  to  discuss  the  ability  of  persons  to  achieve  goals  and 
to  perform  actions  we  introduce  the  operator  can. 

can(p,n)  (s) 

asserts  that  th..  person  p  can  make  the  situation  s  satisfy.  We  see  that 
can  (p,n)  is  a  propositional  fluent  and  that  like  cause,  can  may  be  regarded 
either  as  a  second  order  predicate  or  a  modal  operator.  Our  most  common  use  of 
can  will  be  to  assert  that  a  person  can  perform  a  certain  action.  Thus  we  write 

can(p,  moves  (p,o,l))  (s) 


to  asseit  that  in  situation  s,  the  oerson  p  can  move  the  object  o  to  location  1. 
The  operator  can  satisfies  the  axioms 
Kl.  Wn  Vp  Vp.  [can  (p,n).A(n  3  p)  o  cr-\(p,  p) 

K2.  Wn  Vp^  Vpg.  {  '^can(p^,  n)  a  can(p- , .--.n)] 

IQ.  Wp  VnVp  [can(p,rt)  ^/can  (p,  p)  ^  can(p,n  *'  p)] 

UcinF  Kl  and 


ai)d 

we  can  deduce 


can(p,  moves  (p,  o,  IJ) 

Wp  Vo  VI.  moves  (p,  o,  l)  o  cause  (at(0|l)) 
can  (p,  CBU.se  (at  (o,l;)) 


which  shows  that  the  operators  can  and  cause  often  show  up  in  the  same  fprmula. 


The  ability  of  people  to  perform  .joinv  actions  can  be  expressed  by 
formulas  like 


can(p^,  can  (p^,  marry  (p^iPg))) 
which  suggests  the  conmutative  axiom 


K4.  W  p^  Vpg  Vn.  can(p^,  can(p2,w))  o  can  (pg,  can(p^,n)) 
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A  kind  of  traniltivlty  i«  osproosod  ky  tbo  fellowlagt-' 

Thtor—  •  rro« 

1)  can(p,  ecua«(ir» 

•Ad 

2)  V, '7^'  ^eao(p,  e«uM(p)) 
it  follow',  that 

3)  c*a(p  ,  c«u?«(e«Q(p,  e«ui«(^)))) 

Proof  -  Subatltuta  ean(p,  eAuM(^))  for  ^  lit  axioM  Cl  and  anbatltnta 
cause  (.,;«)  for  7^  and  eause(can(p,  eauaa(^)))  for  ^  in  axtoa  Kl»  Tba 
conclusion  than  follows  by  propositional  caleulua* 

Ic  order  to  discuss  the  aehlevanant  of  goals  ragulrlng  aawaral  eonaaentlvn 
actions  wa  introduce  canultfp.^)  idiMh  is  intandad  to  aaan  that  tha  paraon  p  eaa 
ultiaataly  bring  about  a  situation  satisfying  *  Wa  eonnaet  It  with  and  cauaa 
by  Mans  of  the  asion 

KCl,  V.  Vp  VTp.  can(p»causa(eanult(pi‘7^>;.>:^saault(p,)f ) 

This  axiom  partially  corraaponds  to  the  LI8P-typs  raeuralwt  daflnltlon 

canultCpt^D  "  TP  V  can(p,  causa (canult(p,7r))') 

Wa  also  want  the  axiom 


KC2.  WpV/^.  causa(canult(p,if^))t::?  canult(p,Tp) 


5.  EXAKFLBS 

Ic  Tha  Honkey  ca'a  get  the  Bananae 


The  flrat  example  ve  shall  consider  la  a  ilcuitlon  in  nhieh  a  nunkay 
la  In  a  room  where  a  bunch  of  bananas  la  hanging  fron  the  ealliag  toe  high  to 
reach*  In  the  corner  of  the  room  ia  a  box,  and  tha  solution  to  tha  monkay's 
problem  ia  to  mova  the  box  under  tha  bananas  and  climb  onto  tha  box  froai  nhieh 
tha  bananas  can  be  reached. 

Wa  want  to  describe  the  situation  in  such  a  way  that  it  (follows  from 
our  axioms  and  the  description  that  tha  monitey  can  gat  the  bananas*  In  this 
memorandum  we  shall  not  discuss  the  heuristic  problem  of  how  monkaya  do  or  avsn 
might  solve  the  problem.  Specifically,  we  shall  prova  that 

canult (monkey,  haS'(monkay,  bananas)) 

Tha  situation  is  deseribsd  in  a  very  over  simplified  way  by  tha  follawing  aavan 
statamancst- 

Rl.  Wo.  plaea(u)^  can  (monkey, iiova(nonkay,  box,tt)) 

H2«  WU  Vv  Vp  mova  (p,v,to)9causa(at(v,u)) 

H3.  V  esn(monkay,  climbs  (monkey,  fx>x)) 

H4.  V  VUVvVp.  at(v,u)\cliiiibs(p,v)peausa(at(v,u)Aon<p,w)) 

Hi,  V  place (under (bananas)) 

R6.  V  at(box,  undar(bananss))  ^  on(monkay ,  box),r»  can  (monkey  ,ra<Mdi(nonhay  ,bagann)) 

H),  V  Vp  Vx.  raach(p,x)pcsusa(has(p,x)) 

Tha  reasoning  proceeds  as  follows t  From  1  and  5  by  substitutim  of  ««dar<baaaaia) 
for  u  and  PC  (propositional  ea.^>ulus)  wa  gat 

1)  can(monkey,  mova(box,  undar(bananaa))) 

Using  1)  and  H2  and  axiom  Cl,  we  gat 

2)  esn(nonkay,  csusc(at(box,  under (bananas)))) 

Similarly  H3  and  H4  and  Cl  give 

3)  st(box)  undar(banenas))Pean(aenkay,eauBa(  at(boX|Umdat<hananaa»/^om(mookey,hw))> 
Than  R6  and  R7  give 

d)  at(box,uadar(bananas))Aoo(mankay,box)t>CQii(mDnkay,aauM  <hM(monkay,banMaa))) 

Row,  Ihaeram  1  is  used  to  combine  21  3)  and  4)  to  gat 

5)  aan(monkay,cauae(can(moiAey.f.aMaa(can(menkay,aamaa(has(msnkay,beoaoas»)») 

Using  KCl,  wa  rodufca  this  to 
oanultCmaidcay,  hea(iB.'..Uwy,  banaaaah> 
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2.  AM  EKDGAHB 

A  single  situation  In  a  two  person  gams  can  arias  vhsr|  player  has 
two  moves,  but  whichever  he'ehoosse  player  P2  haa  a  move  that  will  beat  hlnu  This 
situation  nay  be  described  as  follows:- 

1)  ean(pi  ,mi)  Acan(px  ,m2) A  (ni  V  s^) 

2)  [niO  cause(  ff*  A  cmt$»(ir‘2)J 

3)  V.l^x  V  "^2  ^(5«o(P2.  «!)  Acan(p2,n2)  A (ni  V af)] 

A)  V,(iriAni)K  (‘7^2  An2)  Dcau8e(wla(p2)^ 

He  would  like  to  be  able  to  draw  the  conclusion 

3)  canulc(p2,win(p2)) 

Ha  proceed  as  follows:  From  1)  and  2)  we  get 

4)  causedTi)  ^  cau8e(^2) 
and  we  use  axiom  C3  to  get 

5>  cauaeC'ffj  vTt'2) 

Hast  we  weaken  3)  to  get 

<()  V,^|Ocan(p2t  nj)  and 

7)  V.  “*^2  ^  ®**'(P2 .«  ®2) 

and  than  we  use  K1  to. get 

d)  3  can(p2,  1  A  nj)  and 

V  V,  172  J5can(p2,  7^2  An2) 

The  propositional  calculus  gives 

10)  V.TTj  7r2  ^  can(p2,  1^l  A*»l)  c«(P2*  *^2 

and  using  K3  we  get 

11)  y  *772  ^®®n(P2»  (^1  a  “1^  ^("^2  A®2^) 
which  together  with  4)  and  K1  gives 

12)  V,  f/’7f)i'^eta(p2,  cau8e<wtfi(p2))) 
which  together  with  5)  ano  Cl  gives 

13)  eause(can(p2i  cauae(wln(p2))) 

Using  the  axiosm  for  canult  we  now  get 

14)  canult(p2,  win(p2)). 
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After  finishing  the  bulk  of  this  memorandum  I  csme  across  The  8ynts;c 
of  TiiM  bistinctions  4  by  A.N. Prior.  Prior  defines  model  operators  P  end  f share 

P(ir)  means  '  it  has  been  the  case  that^'  and* 

F(^)  means  'it  will  be  the  case  that/T’ 

He  subjects  these  operators  to  a  number  of  axioms  and  rulaa  of  Infaronsa 
In  close  analogy  to  the  well-knownP  53  modal  logic  of  possibility.  Be  also  intarprata 
this  logic  in  a  restricted  prcdica^  calculus  where  the  variables  range  over  tiiMB. 

He  then  extends  his  logic  to  include  a  somewhat  undetermined  future  and  olalma 
(unconvincingly)  that  this  logic  cannot  be  interpreted  in  predicate  calculus. 

I  have  not  yet  made  a  detailed  coiqparison  of  our  logic  with  Prior's,  but 
here  ere  soaie  tentative  conclusions. 

1.  The  causality  logic  should  be  extended  to  allow  infere**ee  about  the  past. 

2*  Causality  logic  should  be  extended  to  allow  inference  that  certain 
propositional  fluents  will  always  hold. 

3.  causeC'^T')  satisfies  the  axioms  for  his  which  means  that  his  futurity 

theory  poseesses.  from  his  point  of  view,  nonrstandard  models.  RsMly.  a  eolleetira 
of  functions  Pi<t),P2(t)  may  satisfy  his  futurity  axioms  and  assign  truth  to 

p(l)A '^(Fp)(o)«  In  our  system  this  is  okay  because  something  can  happen  without 
being  caused  to  happen, 

4.  Zf  we  combine  his  past  and  futurity  axioms,  our  eyetsm  will  no  longer  fit 
his  axioms  and 

PFl.  P  3  '^F('-'P(p)) 

PP2.  p  O 'N/p('vF(p)) 

since  we  do  not  wish  to  say  that  whatever  is,  was  always  inevitable. 
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